13. Coding Exercise

Please use the next concept to complete the following sections of Temporal_Difference.ipynb :

  • Part 0: Explore CliffWalkingEnv
  • Part 1: TD Control: Sarsa
  • Part 2: TD Control: Q-Learning
  • Part 3: TD Control: Expected Sarsa

If you'd like to reference the pseudocode while working on the notebook, you are encouraged to open this sheet in a new window.

## Check Your Implementation

Feel free to check your solution by looking at the corresponding sections in Temporal_Difference_Solution.ipynb .

## Download the Exercise

If you would prefer to work on your own machine, you can download the exercise from the DRLND GitHub repository .

Next Concept